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ABSTRACT 

The Vocational and Applied Arts (VAE) Management 
Information Systeu (MIS) is designed to select, store, process, and 
transmit information needed in a competency-based teacher education 
(CBTE) program. The system is computerized and is composed of six 
subsystems which deal with admissions, class scheduling, faculty 
loads, instruction, field experience, and program evaluation; it 
functions through a series of data banks which interface and which 
can be used interchangeably to provide reports and analyses. These 
data banks consist of the following files: 1) Master Student; 2) Plan 
of Work; 3) Master Faculty; 4) Course Objectives and Parameters; 5) 
Program Evaluation; and 6) Followup. The system utilizes two IEM 360 
Model 67 computers with Fairchild semiconduit memories and has access 
to three UCC 1135 terminals and an IBM Magnetic Card Communicating 
Typewriter. A faculty manual, a rystem operations manual, an 
equipment operation manual, and aii instructional system manual 
support the operation of the entire system. (Author/LB) 
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THE DESIGN AND IMPLEMENTATION OF A MANAGEMENT INFORMATION 
SYSTEM TO FACILITATE THE FUNCTIONING OF A CBTE PROGRAM 

\ Even though the instructional phase of a competency-based teacher 
educajplon system may well be considered the heart of the program, it will 
cease to function if a management information system Is not developed to 
support vital decisions. 

The intent of this paper is to show how a Management Information 
System (MIS) designed in an orderly, systematic manner can provide 
benefits to faculty and students which will help them facilitate more 
effective education. In the design of the MIS at Wayne State University, 
the individuality of both staff member and student have been considered. 
We have attempted to preserve this individuality by focusing our planning 
and tools on the student and assuring that his capabilities and needs 
are considered throughout the system. In the same manner, the faculty 
member's uniqueness has been preserved by providing a series of 
procedures which ultimately culminate in the same goal but allow a 
faculty member the choice of paths to follow. 

What is the VAE Management Information System? 

The major purpose of the VAE Management Information System is to 
select, store, process, and transmit information to the faculty and 
students at a time when it can most effectively be used, enabling them 
to make more knowledgeable decisions. The MIS is a computer-based system, 
basically meeting the criteria for a real-time system; however, due to 
our need to be as cost conscious as possible and the lack of immediate 
need for some information, a delay may occur at times in the updating 
of f lies . 

Since the main purpose of the MIS Is to provide information to 
the faculty when they need it and with only a limited support staff, 
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the faculty is encourage to use the remote terminals to obtain their own 
informational printouts . 
How Was the MIS Developed? 

The educational system design procedure must take the planner 
from where he is to where he wants to be in an orderly, logical manner. 
The design of an MIS follows the same problem-solving process as does 
the instructional system design. Figure 1 shows the general process through 
which the design of any MIS must progress. 



Identify 
Goals 



Figure 1, , , General MIS Design Procedure 
Revise as Needed 
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However, the design of an MIS can and must be dissected into 
nuch smaller and more manageable components* The detailed development 
of our MIS is presented in Figure 2, 



Identification of Subsystems 

The identification of the subsystems, their goals, and the 
constraints on each cannot be begun until the designer is oriented to 
the faculty and the departmental philosophy and personality. This must 
be accomplished if the design of the system is to meet the needs of the 
department ,. yet kept within the constraints placed upon it by various 
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Figure 2... Specific Development of MIS 
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Idyocyncracies or characteristics of the staff and students* Since 
university professors are notorious for "doing their own thing*" if 
the system operation is to be a cooperative venture with everyone 
participating effectively, it is necessary to elicit as much input 
from the faculty, students, and clerical staff as possible. 

The identification of subsystems was begun by listing all the 
general functions which were being performed in the Department at that 
time, i.e., admitting students, as well as those functions which would 
have to be initiated to make a competency-based system. These functions 
were then separated into logical groups according to similarity. We 
had our first list of subsystems. This list was refined to six subsystems 
as additional analysis took place. The relationship of the six subsystems 
and the feedback circuitry are illustrated in Figure 3. 



Figure 3 ... Relationship of MIS Subsystems 
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Admission Subsystem 

This subsystem was designed to facilitate the admission oi a 
student in such a way that the process and the collected data would 
be beneficial to both faculty and students. The major time parameter 
of the subsystem is to process the student's admission and enter his 
records into the computer within one week's time. 

Three constraints were kept in mind when this subsystem was 
developed—the faculty's aversion to paperwork, little knowledge on 
the part of the student of the departmental system, and limited and 
inexperienced clerical help. The faculty was especially desirous of 
eliminating routine paperwork so they could spend more time with 
students, an essential component of a competency-based program. A 
plan of work (Appendix A) was developed that was easy to use but yet 
provided the information which was needed to enter the student records 
into the data bank and provide input for class enrollment projections 
and various profile reports. The Plan of Work is prepared by a faculty 
advisor in consultation with the student. 

Prior to the faculty-student conference, the student participates 
in a multi-media experience which explains the VAE competency -based 
program and the sequence of experiences he will have. 

The major reason for computerizing the Plan of Work data was 
to provide for the faculty a current projection of enrollment figures 
for all classes. By requiring a plan of work for each student, the 
faculty is able to maximize the utilization of all resources. The 
data from the plan benefits the students by guaranteeing experiences 
for him with a competent instructor at the appropriate time. 
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Any change which affects the department's scheduling procedure 
must be made through a formal change* A monitoring system has been 
developed which Informs the student If he has deviated from his plan 
of work by sending him a computer-generated letter at the beginning 
of each quarter. 

Figure 4 displays the overall subsystem, the computer reports 
provided, persons to whom the reports are disseminated, and the types 
of decisions that can be made on the basis of the reports. The small 
circle containing a "D" Implies a decision point for appropriate 
personnel. Branching from this decision point are the kinds of 
decisions that may be made. The top of each report symbol shows the 
person or group to whom that report is disseminated* 

Class Scheduling Subsystem 

Much time is spent each quarter by the administration deciding 
which courses to offer, hours to be offered, and assignments of teachers. 
By developing a computerized class schedule subsystem, a tentative 
basic schedule can be generated which can be used to make the final 
schedule . 

The data garnered from the plan of work file gives the faculty 
the ability to make decisions as to which classes should be offered 
during each quarter. It also predicts the number of faculty needed 
each quarter as well as the predicted faculty load of each . 

In addition, the expertise or past experiences needed on the 
part of the faculty to most effectively teach each objective of the 
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Figure 4 Flowchart of Admissions Subsystem 
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program may be identified. These then may be matched with those the 
faculty possesses when assigning an instructor to a class. 

Figure 5 shows the class scheduling subsystem and its resultant 
reports* 

Faculty Load Subsystem 

As we began to work with the competency-based teacher education 
program, we recognized the need for a more equitable method for determining 
faculty load credit--a method which would ensure that the activities 
required of faculty in a competency-based program would be given credit. 
In order for all facets of activitiy to be given credit and for there to 
be an interface between the class scheduling subsystem, the faculty 
load subsystem, and the instructional and field experience subsystems, 
it was essential to computerize the data. A report is provided which 
shows the number of credit hours generated by each professor and any 
parameters he has exceeded. It is possible to know whether the University 
owes credit to the professor or vice versa. This portion of the system 
has indeed been one of the most difficult to design satisfactorily. 
The model ^8 not perfectly equitable and completely workable at this 
time; however, we believe we have the conduit which, in time, will 
provide the Department with a satisfactory method for determining credit 
in a competency-based program. Figure 6 depicts the Faculty Load 
Subsystem. 
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Figure 5. . .Flowchart of Class Scheduling Subsystem 
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Figure 6. ♦ .Flowchart of Faculty Load Subsystem 
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Instructional Management Subsystem 

This subsystem includes instructional activities that take place 
on campus versus the Field Experiences Subsystem that includes all 
Instructional activities off campus, 

A competency-based program does, in fact, necessitate more 
record keeping than the traditional program. Thus, the primary goal 
of this subsystem is to eliminate as much manual record keeping as 
possible on the part of the faculty, but at the same time provide 
•.aformation on the status of each student as he progresses through the 
program, as veil as sufficient data for formative and summative 
evaluation. Figure 7 shows the progresion of data and the resultant 
reports for this subsystem, 

Classlists (Appendix B) are computer-generated from the university 
registration magnetic tapes. The classlists are combined with the data 
in the Course Objective Parameter File (discussed below) to produce 
the Objective Record Form (Appendix C) . 

At the beginning of the quarter, the professor recleves the 
History Report (Appendix D) which lists the students enrolled in the 
class and the historical record of each student. It lists the objectives 
that should have been completed and how the student performed on each. 
Those objectives that are directly prerequisite to the objectives in 
the course are indicated by an asterick. This information, along with 
the results of the prerequisite skills test, provide the faculty with 
decision-making capabilities concerning remedial work and reinforcement. 

A faculty member has his choice of methods for submitting 
objective completion data. He may use the Objective Record Form which 
is a computerized grade book. It allows the faculty member to submit 
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Figure 7. »• Flowchart of Instructional Subsystem (On-campus Activities) 1* 
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his data for all his students in one class at the end of the quarter. 
The data is keypunched directly from the form and then merged into the 
Program Evaluation File . 

If the faculty member chooses to submit the data on a single 
student for a single objective or individualized instructional module, 
he may use the Optical Mark Recognition (OMR) Card (Appendix E). This 
same card may also be used for those students who receive an Incomp lete" 
in a class and complete single objectives after the Objective Record Form 
has been submitted* 

The OMR card may be submitted on a periodic basis during the 
quarter if the faculty member wishes to receive on a regular basis a 
computerized status report of how each student is progressing. 
Appendix F is an example of this report. It shows either the objectives 
or modules the student has completed to date and those which he still 
must complete. 

At the end of the quarter, the Status Letter (Appendix G) is 
sent to the student. It reports which objectives he has completed, 
and which objectives he has not completed with some suggestions to 
help him complete them successfully. 

Histograms are provided for all faculty, regardless of whether 

they report completion of single objectives or completion of modules. 

The report gives histograms of the number of people completing 

exemption tests or exit tests on each objective, number of times 

recycled through instruction, and time spent to complete each objective. 

The report also shows the time period during the quarter when each 

objective was completed. This provides input for sequencing decisions 

within a course. 
O 
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The 0» rriculum Status Report of Students (Appendix H) is provided 
to each curriculum area t show which students are completing objectives 

satisfactorily and on schedule, which students are behind schedule f and 

■ 

which students have not completed any objectives for a period of time. 



These students are flagged. The data from this report may be used for 



counseling purposes or followup on inactive students. 

The data collected in the above system provides feedback for 
program revision, delivery system and materials revision, as well as 
counseling and followup information to be used by the faculty. 



Field Experiences Subsystem 

The primary goals of the data collection in the Field Experiences 
Subsystem are to ensure that the intern teacher's progress is known by 
the University supervisor at all times, to assist in the allocation of 
the faculty member's time to best advantage, to provide constant feed- 
back for revising and providing relevant content for the seminar that 
accompanies the intern/ teaching experience, and to serve as a guidance 
device for the public school-university team. 



beginning of the teaching experience. The student, cooperating 
teacher, and the university supervisor (at designated times) evaluate 
the student's performance with respect to the test for each objective* 
These cards serve as direct input into the computer. 



teachers is generated for the university supervisors* This same 
information is provided to the student and cooperating teacher on a 
less frequent basis* 

O 



The student is given a yet of OMR cards (discussed above) at the 



A weekly status report containing the progress of the intern 




ERIC 



20 

The same kind of data is collected during the field experiences 
prior to intern teaching. We believe that some of our best predictive 
data will be collected from these experiences* We hope to determine 
whether there are certain levels of performance at this point which 
will enable us to predict the successful teacher. 

Program Evaluation Subsystem 

Feedback is provided for virtually all phases of the program, 
beginning with eachob j ec t ive , delivery system, exit test, and finally 
concluding with the evaluation of success of the students of the 
Department's graduates. Students complete the Content Evaluation 
Questionnaire (Appendix I) during the quarter as they progress through 
the objectives. This data is then keypunched from the form and 
entered into the computer, resulting in the Content Evaluation Report* 
This report is used as one basis for objective and test revision. 

Our data collection and analysis are being kept within the scope 
of what actually has an effect on Departmental operations and decisions. 
Appendix J shows some of the kinds of questions that we are trying to 
answer through this subsystem. 

Data Bank Development 

The data bank consists of six computerized files— the Master 
Student File, the Plan of Work File, the Master Faculty File, the Course 
Objective and Parameter File, the Program Evaluation File, and the 
Followup File. The contents of *ach file are shown in Figure 8. 

All of the data in the Master Student File are obtained from 
university registration magnetic tapes. The file is updated at the 
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Figure 8. . .Contents of Data Files 
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Contents of Master Student File 

Admission Date 

Social Security Number 

Name 

Address 

Telephone 

Sex 

Marital Status 

Birthday 

Graduate 

Senior College 

Resident 

College 

Curriculum Area 
Rank 

Cumulative honor point total 
Cumulative resident hours 
Cumulative total hours 
Cumulative honor point base 
Number of courses recorded 



Contents of Plan of Work File 
New/revised plan 
Curriculum area 
Rank 

Social security number 

Name 

Address 

Telephone number 
Quarter admitted to department 
Expected graduation date 
Date plan was made or revised 

For each VAE course scheduled: 
Course number 
Quarter expected to take 
Year expected to take 

For each non-VAE course: 
Course number 



For each course taken: 

Quarter and year course taken 

Section number 

Grade received 

Withdrawal code 

Graduate /undergraduate code 

Credit hours 

Course number 

Length of course in weeks 



Contents of Course Objective Parameter File 

For each objective of program: 

Objective Number 

Course where taught 

Field tested/campus tested objective 

Kit in which objective is taught 

Prerequisite objectives 

Competencies to which objective is matched 
Description of objective 
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Contents of Program Evaluation File 

Social security number 

Name 

For each objective in program: 

Objective number 

Quarter started objective 

Date completed objective 

Time to complete objective 

Number of recycles 

Grade code 

(1) Passed exemption test 

(2) Did not pass exemption test-passed 

exit test 

(3) Passed exemption test - 

passed exit test 



Contents of Master Faculty File 

Social security number 

Name 

Curriculum area 
Highest degree held 
Specialties 

Preferred courses to teach 

For each course taught; 
Course number 
Section number 
Quarter taught 
Year taught 

Number of students in class 
Field time (hours and minutes) 
Credit hours of course 
Team taught 

Faculty load credit for instructional 
mode according to VAE model for each 
quarter 

Faculty load credit for each quarter 
according to WSU model 

For each committee to which professor 
belongs: 

Committee code number 
Quarter he belonged 
Year he belonged 

Faculty load credit tor Process Group 
for each quarter according to VAE 
Model 

For each research and development activity: 

Activity code number 

Quarter performed 

Year performed 

Units received 
Faculty load credit for R&D group for each 

quarter according to VAE model 
Total faculty load for each quarter 

according to VAE model 
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beginning and end of each quarter* adding new courses and grades, and 
changing the appropriate profile data. This updating Is performed by 
a computer program and utilizes very little clerical time. Graduates 
are transferred from the appropriate file to the follovup magnetic tape 
file once per year* Inactive students (those who have not taken a 
course within the past two years) are removed from the file by a computer 
program and their records are microfilmed. 

In addition to the regular profile programs, scheduling program, 
and other output which have been discussed, there is a conversational 
program available which allows the faculty to stipulate any of thirteen 
parameters in the Plan of Work File and the Master Student File and 
utilize them in all possible combinations up to all thirteen at one 
time, A multiplicity of reports can be generated within a few minutes. 

The criteria for assessing the value of the data and thus 
assisting us in making the decision as to the continuance of the collection 
are: (1) validity--is the information what the faculty needs? 
(2) reliability—is the information reproducible? (3) timeliness — is 
the information available when the faculty needs it? (4) pervasiveness-- 
does the information reach people who need it? and (5) cr edibility-- 
i8 the information trusted by the faculty?* 

The system utilizes two IBM 360, Model 67, computer systems 
with Fairchild semiconduit uemories. The Department has access to three 
UCC 1135 terminals and an IBM Magnetic Card Communicating Typewriter. 

All data files except the Followup File are located 
on disk storage, thus allowing us on-line access. In addition, all 
program files used frequently by staff and faculty are stored on disk. 
Backups of all files are stored on magnetic tapes. 
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Development of Documentation 

The key to the successful operation of a system is the documen- 
tation, The major criteria for the writing of the manuals have been 
(1) ease in reading and understanding! and (2) quick access to informa- 
tion. 

There are four manuals! (1) Faculty Manual (2) System Operations 
Manual (Technical Section and Non- technical Section (3) Equipment Operations 
Manual (4) Instructional System Manual 

The manuals include such things as summary and detailed flowcharts 
of the various tasks, hardware specifications, software including forms 
and computer programs, performance specifications where appropriate, 
performance schedules, cost of execution where appropriate, procedures 
for modification of the system, decision tables, and a complete digest 
of the instructional and MIS design. 

Summary 

Designing and implementing a Management Information System is 
not easy, It Is frustrating and time consuming; however, I am convinced 
that cotapet ency-based education programs will be a casualty for want of 
adequate information to support vital decisions unless Management 
Information Systems are utilized, 
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FOOTNOTES 



1. Stuff lebeam, Daniel, "Toward A Science of Educational Evaluation," 
Educational Technology , July 30, 1968. 
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Appendix I 
Content Evaluation Questionnaire 

1. Did prerequisite courses, if any, give you an adequate foundation in meeting 
the objectives of this course? 

Yes No No Prerequisite 

Requirements 

2. Was adequate time, materials, and facilities provided for you to achieve 
this objective? 

Yes No 

3. How meaningful were the assignments in relation to the mastery of this 
objective? 

Assignments were Assignments Could have Uncertain 

helptul in attain- Helped some mastered objec- 

Mastery but could be tive without 

improved completing 
assignments 

4. How appropriate were the methods (kits, films, etc.) used in conveying the 
instruction to master this objective? 

Appropriate— Were OK but Were Uncertain 

I liked them I prefer other Inappropriate 
methods 

5. Did the exit test accurately measure the behavior sought in this objective? 
Yes No 

6» Do you feel you have really mastered this objective? 

Yes feel very Yes but need Yes but need Did not pass 

competent some reinforcement much more exit test 

instruction 

7, In hindsight do you think you could have passed the exemption test on this 
objective at the beginning of the quarter without receiving instructions- 
Yes No 

8, Do you feel this objective is essential to your teaching preparation? 
Yes No 
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Appendix J 



STRATEGIES FOR PROGRAM EVALUATION 
Major Questions to be Answered through Data Analysis 



I . REFERRAL SUBSYSTEM 

1. Is there a change over a period fo time in the demographic 
and academij; characteristics of students when they enter 
the Department? 

2. If there are changes , are they systematic? 

3. Are these changes corrlated with any trends in other variables? 

4. Is it possible to predict the students who apply for admission, 
make a plan of work, and never show up for classes? What kind 
of characteristics does he have? What happens that causes 

him to go elsewhere rather than here? 

5. What is the percentage level of dropouts at the various 
points in the sequence? 

6. Is there a significant difference between those dropping 

out and those not dropping out in terms of age, sex, and HPA? 

7. Are there other relevant variables which may be causing the 
dropping out? 

8. Is there any change in characteristics of dropouts and 
reasons for dropouts over a period of time? 

9. What attempts are being made to reduce the dropout problem 
and how successful are they? 



II. INSTRUCTIONAL SUBSYSTEM 

1. What is the relationship from quarter to quarter between 
achievement levels of each class as measured by number of 
students completing objectives within time limit, number 
of recycles through instruction? 

2. Do delivery systems differ in the degree to which students 
achieve in terms of objectives completed, time to complete 
them, and number of recycles? 



What combination of delivery system with student characteristics 
seems to provide minimum or maximum achievement? 



r 



4. What is the predictive validity of the achievement of VAE 
objectives with overall HPA? 

5. What is the predictive validity of the achievement of VAE 
high level obcjctives with overall HPA? 

6. How comparable are the resuls of the various methods class 
with the achievement on the various facets of the intern 

7. How consistent is the achievement of single individuals from 
course to course? 

8. What is the relationship between the attitudes of the faculty 
and the students achievement on the objectives? 

9. What are the characteristics possessed by individuals who 
pass the exemption tests? 



III. INTERN TEACHING SUBSYSTEM 

1. What is the relationship between the achievement of the 
student teacher test and achievement in prior porfessional 
courses? 

2. What is the relationship between the achievement of the 
student teaching test and the achievement of the prior field 
experiences ? 

3. What is the relationship between the attitudes of the 
cooperating theacher and the achievement on the student teaching 

4. What is the relationship between the attitudes of the supervising 
teacher and*.' the student achievement on the student teaching test? 

5. What is the relationship between the quality of contacts by the 
supervising teacher and the achievement of the student in 

the student teaching test as viewed by the student, the coope- 
rating teacher, and the supervis ing^ teacher ? 

6. What is the relationship between the number of visits and the 
achievement of the student in the student teacher test? 



IV. FOLLOWUP 

1. What is the relationship between achievement on student 
teaching test and success in teaching 1 year later and 5 
years later as viewed by (a) the teacher, (b) his peers, 
(c) his students, "(d) his administrator . 

2. What does the teacher view as the major contributions of the 
methods cla$ses, the foundations classes, student teaching, 
and the field experiences after teaching one year? 



3. Is there any evidence of change in the kinds of jobs 
graduates take over a period of time? 

4. What is the percentage of students who are earning a 
living in the education field one year, 5 year, 10 years 
after graduation? 

5. What will be th© extent of the need for VAE teachers in 
future years? 

6. What is the relationship between the number of students who 
graduate from VAE and the number of those who return for graduate 
work ? 

7. Are there any characteristics which relate to those who 
return and those who don t? 



V. FACULTY LOAD SUBSYSTEM 

1. What is the relationship between success in teaching a class 
as viewed by the faculty and his students and the experiences 
or academic expertise related to the class that he possesses? 

2. What is the relationship between what faculty views as a full 
load vs. what the VAE model views as a full load? 



VI. CLASS SCHEDULING SUBSYSTEM 

1. What is the relationship between when classes are scheduled 
and the wishes of the faculty? 

2. What is the percentage of increase/decrease in actual 
enrollment vs. projected enrollment? 

3. What is the relationship between when classes are scheduled 
and the wishes of the students? 



VII. CONTENT AND TESTS 

1. What is the relationship between the level(bloom) of the 
objective and the sequence within which it falls? (Simple to 
complex) 

2. What is the predictability of success on the prerequisite 
skills test if former objective passed? 

3. What is the span of time which occurs between passing objective 
and not passing the prerequisite skills item for that objective? 



